A Workflow-Optimized Storage System:

نویسندگان

  • Samer Al-Kiswany
  • Emalayan Vairavanathan
  • Lauro B. Costa
  • Hao Yang
  • Matei Ripeanu
چکیده

This paper proposes using file system custom metadata as a bidirectional communication channel between applications and the storage system. This channel can be used to pass hints that enable cross-layer optimizations, an option hindered today by the ossified file-system interface. We study this approach in context of storage system support for largescale workflow execution systems: Our workflow optimized storage system (WOSS), exploits application hints to provide per-file optimized operations, and exposes data location to enable location-aware scheduling. This paper argues that an incremental adoption path for adopting cross-layer optimizations in storage systems exists, presents the system architecture for a workflow-optimized storage system and its integration with a workflow runtime engine, and evaluates the proposed approach using synthetic as well as real applications workloads.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A cross-layer optimized storage system for workflow applications

This paper proposes using file system custom metadata as a bidirectional communication channel between applications and the storage middleware. This channel can be used to pass hints that enable cross-layer optimizations, an option hindered today by the ossified file-system interface. We study this approach in the context of storage system support for large-scale workflow execution systems: Our...

متن کامل

RDFProv: A relational RDF store for querying and managing scientific workflow provenance

Article history: Received 12 October 2008 Received in revised form 8 March 2010 Accepted 11 March 2010 Available online 23 March 2010 Provenance metadata has become increasingly important to support scientific discovery reproducibility, result interpretation, and problem diagnosis in scientific workflow environments. The provenance management problem concerns the efficiency and effectiveness of...

متن کامل

Electrical Energy Storage on the Hybrid Grid of Renewable Energy System Using Fuzzy Controller Optimization Algorithm

The main risks of arising from the using fossil fuels can be referred to environmental pollution, the effects of greenhouse gases, climate change and acid rain. For this reason, efficient use of energy in economic development has always been considered as an important goal of sustainable development. In this study, the effects of time-varying electricity prices in the energy storage components ...

متن کامل

WorkBrain: Merging Organizational Memory and Workflow Management Systems

Despite the enthusiasm, the workflow management idea faces currently, some problems occur when setting up large workflow applications for complex business processes. To solve some of these problems, a combination of workflow management concepts and the notion of "organizational memory information systems" is suggested. The basic idea is to create an evolutionary workflow management system using...

متن کامل

Scientific Workflow Provenance Metadata Management Using an RDBMS-based RDF Store

Provenance management has become increasingly important to support scientific discovery reproducibility, result interpretation, and problem diagnosis in scientific workflow environments. This paper proposes an approach to provenance management that seamlessly integrates the interoperability, extensibility, and reasoning advantages of Semantic Web technologies with the storage and querying power...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013